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SUMMARY 


In  fn^s  paper  we  discuss  a  representation  of  the  distri¬ 
bution  function  of  the  solution  of  the  stochastic  differential 
equation  u'  •  g(u)  +  r(t),  where  r(t)  Is  a  given  stochastic 
function,  and  g(u)  Is  assumed  to  be  either  strictly  convex 
or  strictly  concave  for  all  u. 

Extensions  of  this  result  to  more  general  types  of  norv- 
llnear  functional  equations  may  be  readily  obtained,  following 
the  techniques  given  in  "Functional  Equations  In  the  Hieory  of 
Dynamic  Programming— V:  Positivity  and  Quasi— linearity," 

Proc.  Nat.  Acad.  Scl.,  Vol.  41  (1955),  PP.  743-746. 


P-1125 

7-9-57 

-1- 


ON  THE  REPRESENTATION  OP  THE  SOLUTION 
OP  A  CLASS  OP  STOCHASTIC  DIPPERENTIAL  EQUATIONS 

Richard  Bellman 


1,  INTRODUCTION 

In  previous  papers,  [l]  ,  [2],  we  have  discussed  the 
representation  of  the  solutions  of  various  classes  of  non¬ 
linear  differential  eq\iatlons  in  terms  of  the  maximum  opera^- 
tlon.  In  this  paper,  we  wish  to  Indicate  the  application  of 
similar  techniques  to  the  representation  of  the  distribution 
function  of  the  solution  of  stochastic  differential  equations. 
In  the  case  where  the  equation  has  the  form 

(1.1)  du/dt  ••  g(u)  r(t),  u(0)  «  c, 

with  r(t)  a  random  function  with  given  distribution,  of 
which  a  particularly  Important  case  is  the  Rlccatl  equation 

(1.2)  du/dt  ■  u^  +  r(t),  u(0)  ■  c, 

the  answer  assumes  an  especially  simple  form. 

TTie  nonlinear  equation  In  (1.2)  Is  associated  with  the 
linear  equation 

(1.3)  d^w/dt^  -  r(t)w  -  0, 

which  plays  a  role  In  the  study  of  wave  propagation  through 
a  random  medium. 

2.  QUASI-LINEARIZATION 


Let  us  make  the  fundamental  assumption  that  g(u)  is  a 
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Btrlctly  convex  twice  differentiable  function  of  u  for 
—  00  <  u  <  00  .  Then  we  may  write 

(2.1)  g(u)  -  Max  (g(v)  +  (u-v)g»(v)). 

The  equa'.lon  In  (l.l)  can  then  be  written  In  the  form 

(2.2)  ^  -  Max  [g(v)  +  (u-v)g'(v)],  u(0)  -  c. 

It  follows  that  we  have  the  Inequality 
^2.3)  ^>s(v)  +  (u-v)g'(v)  +  r(t),  u(0)  -  c, 

valid  for  any  function  v(t).  Let  U(v;t)  denote  the  solu¬ 
tion  of  the  equation 

^  **■  ■  c. 

Then,  as  In  [l] ,  [2],  we  have  the  Inequality 
(2.5)  u  >  U(v;t),  t  >  0, 
for  all  V. 

5.  REPRESENTATION  OF  THE  PROBABILITY  DISTRIBUTION  FOR  U 
Prom  the  relation  given  In  (2.4)  we  derive  the  obvious 
Inequality 

(3.1)  Prob  (u  >  x)  >  Prob  (U(v;t)  >  x) 

for  —  00  <  x  <00  and  all  random  functions  v(t). 

Since  we  have  equality  for  v  -  u,  we  can  state  the 
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following  result. 

’nieorem.  Let  u(t)  ^  the  random  function  determined  by 
the  solution  of  the  stochastic  differential  equation  In  (l.l), 
assumed  to  exist  for  0  <  t  <  T,  and  assume  that  g(u)  a 
strictly  convex  twice  differentiable  function  of  u  for 
—  00  <  u  <  09  . 

Then,  for  0  ^  t  <  T  and  —  oo  <  x  <  oo ,  have  the 
representation 

(3«2)  Prob  (u  >  x)  -  Max  Prob  (V(v;t)  >  x), 

where  the  maximization  Is  over  all  random  functions  v(t) 
defined  over  0  <[  t  ^  T. 

».  DISCUSSION 

It  Is  easy  to  see  that  corresponding  results  can  be  ob¬ 
tained  for  nonlinear  stochastic  functional  equations  of  the 
form 

(4.1)  L(u)  -  N(u)  r(t), 

whenever  N(u)  has  the  required  convexity,  or  concavity, 
property  and  L(u)  possesses  the  requisite  positivity 
property,  following  the  general  pattern  of  the  discussion  in 
[l]  and  [2]  . 
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